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A  PROBLEM  ON  RANDOM  WALK 

R.  SHERMAN  LEHMAN 

STANFORD  UNIVERSITY 

1.  From  an  urn  containing  an  equal  number  of  each  of  l  kinds  of  balls,  random 
drawings  are  made.  After  each  drawing  the  ball  is  returned  to  the  urn,  so  that  each 
drawing  is  independent  of  every  other.  If  the  drawings  are  repeated  indefinitely, 
what  is  the  probability  that  after  some  drawing  in  the  sequence  an  equal  number 
of  each  of  the  l  kinds  of  balls  will  have  been  drawn? 

When  an  equal  number  of  each  of  the  l  kinds  of  balls  have  been  drawn,  we  shall 
say  that  an  equalization  occurs.  In  this  paper  we  shall  show  that  for  /  =  2  or  /  =  3 
the  probability  that  an  equalization  will  occur  is  1,  while  for  l  ^  4  the  probability 
is  less  than  l.1 

2.  This  problem  can  be  interpreted  as  a  random  walk  in  a  network  of  “streets” 
in  (/  —  l)-dimensional  space.  The  drawing  of  a  ball  of  a  given  kind  is  represented 
by  the  walker’s  moving  a  fixed  distance  in  a  given  direction.  Equalization  is  repre¬ 
sented  by  a  return  to  the  origin. 

A  similar  problem  has  been  investigated  by  G.  Polya  [2] :  the  random  walk  in 
a  network  of  “streets”  in  d-dimensional  space  where  the  “streets”  are  parallel  to 
the  coordinate  axes.  The  probability  of  passing  through  a  given  point  at  least  once 
tends  to  1  for  d  =  1  or  d  =  2  but  does  not  tend  to  1  for  d  ^  3.  Since  in  the  pres¬ 
ent  problem  the  random  walk  takes  place  in  (/  —  1)  dimensions,  the  results  are 
entirely  analogous. 

For  1=2  the  random  walk  occurs  on  a  straight  line.  The  walker  moves  one 
unit  to  the  right  when  a  ball  of  the  first  kind  is  drawn  and  one  unit  to  the  left 
when  a  ball  of  the  second  kind  is  drawn.  It  is  clear  that  equalization  is  represented 
by  a  return  to  the  origin. 

For  1=3  the  random  walk  takes  place  in  a  network  of  streets  in  a  plane.  We 
shall  use  the  complex  plane.  Let  w  =  |(  —  1  +  V3i)>  a  cube  root  of  unity. 

Represent  the  drawing  of  a  ball  by  the  addition  of  1,  w,  or  co2  according  as  a 
ball  of  the  first,  second  or  third  kind  is  drawn.  If  r  balls  of  the  first  kind,  s  of  the 
second  kind  and  t  of  the  third  kind  have  been  drawn,  the  random  walker  will  be 
at  the  point 

r  -f-  sco  +  tec2 . 

If  there  is  a  return  to  the  origin, 

r  4-  sea  +  too2  =  0  . 

We  know  1  +  co  +  «2  =  0.  Therefore,  (r  —  t)  +  (s  —  /)w  =  0.  It  follows  that 
r  =  s  =  t.  Equalization  occurs.  On  the  other  hand,  if  equalization  occurs, 

r  =  s  =  t ,  r  +  +  /w2  =  r  (1  +  «  +  w2)  =  0  . 

1  It  was  pointed  out  to  me  that  certain  parts  of  my  result  are  given  in  chapter  12  of  Professor 
W.  Feller’s  recent  book  [1]  and  that  the  whole  result  can  be  derived  by  the  method  given  there. 
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A  return  to  the  origin  occurs  when  and  only  when  there  is  an  equalization. 

The  random  walk  takes  place  in  a  network  of  equilateral  triangles.  The  junc¬ 
tion  points,  where  the  streets  meet,  are  all  points,  a  +  6a>,  where  a  and  b  are  arbi¬ 
trary  integers.  The  streets  are  one  way  streets. 

For  /  =  4  the  random  walk  takes  place  in  three  dimensional  space.  Using  vec¬ 
tor  notation,2  let 

(1)  a  =  i  +  j  +  k  , 

b  =  i  -  j  -  k  , 
c  =  —  i  +  j  -  k  , 
d  =  —  1  -  j  +  k  . 

Represent  the  drawing  of  a  ball  by  the  addition  of  a,  b,  c  or  d  according  as  a  ball 
of  the  first,  second,  third  or  fourth  kind  is  drawn.  If  r  balls  of  the  first  kind,  s  of  the 
second,  t  of  the  third  and  u  of  the  fourth  have  been  drawn,  the  random  walker  will 
be  at  the  point 

ar  4-  bs  +  ct  +  du  . 


If  there  is  a  return  to  the  origin, 

ar  +  bs  +  ct  +  du  =  0  . 

From  (1),  it  follows  that 

a+&-i-c+d=0. 

Therefore, 

a(r  —  u)  +  b  (5  —  u)  +  c  (/  —  u)  =  0  . 


But  a,  b,  c  are  linearly  independent.  Consequently,  r  —  s  =  t  =  u  and  equaliza¬ 
tion  occurs.  On  the  other  hand,  if  r  =  s  =  t  =  w, 

ar  +  bs  +  ct  +  du  =  r  (a  +  b  +  c  +  d)  —  0  . 


Thus,  a  return  to  the  origin  occurs  when  and  only  when  there  is  equalization. 
Using  (1),  we  have 

ar  +  bs  +  ct  +  du  =  i  (r  +  s  —  /  —  u)  +  j  (r  —  s  -j-  t  —  u)  +  k  (r  —  s  —  t  +  u) 
—  ix  -J-  jy  +  kz  . 

Then,  x  =  y  =  z  (mod  2).  Also, 

0  =  0«i+  o-y+  0-*, 

a  =  l-£+  1\/+  1**, 

a  +  b  =  2i ,  a  +  c  =  2j ,  a  -f-  d  =  2k  , 

c  d  =  —  2i ,  b  d  =  —  2j ,  &  -f-  c  =  —  2 k  . 


From  this,  it  follows  that  ix  -f-  jy  +  kz  is  a  junction  point  of  the  “street”  net¬ 
work  if  and  only  if  x  =  y  =  z  (mod  2). 

Each  point  with  integer  coordinates  is  at  the  center  of  a  cube  with  sides  of  length 
one  and  faces  parallel  to  the  coordinate  planes.  The  network  of  “streets”  joins  the 
center  of  every  fourth  cube.  The  “streets”  which  are  the  diagonals  of  the  cubes 
are  one  way  streets. 

2  A  vector  is  indicated  by  boldface  type. 
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3.  The  probability  of  drawing  j\  balls  of  the  first  kind,  j2  balls  of  the  second 
kind  and,  in  general,  7*  balls  of  the  &-th  kind  in  the  first  n  times  is  the  coefficient  of 
x{ixfy  .  .  .  x>tl  in  the  polynomial 

+  %2  ~h  •  •  •  4~  %i 

l  /  .  .  .  Jl 


Q 


The  expected  number  of  equalizations  in  the  first  n  times,  where  ml  S  n  < 
( m  +  1)/,  is 

l\  .  (2/)!  ,  ,  (ml)\ 


IP/*  '  2  l*p* 


m\llml ' 


The  &-th  term  represents  the  expected  number  of  equalizations  on  the  kl-th  time. 
The  expected  number  of  equalizations  in  n  times  is  also 


Pi"  +  P2n)  +  •  •  •  +  Pm 

where  p,-n)  is  the  expected  number  of  7-th  equalizations.  But  pjn)  is  also  the  prob¬ 
ability  that  a  7-th  equalization  will  occur.  Obviously,  pjn+1)  ^  pjn)  for  all  n.  Be¬ 
cause  it  is  a  probability  pjn)  ^  1  for  all  n.  The  sequence  { pjn) }  must,  therefore, 
tend  to  a  limit.  Let  lim  pjn)  =  p,-.  Let  xn  be  the  probability  that  an  equaliza- 

n— >00 

tion  will  occur  in  the  first  n  times.  Then,  x„  =  p[n)  and  lim  irn  =  ir  =  pi. 

n — >oo 

The  probability  that  a  second  equalization  will  occur  in  the  first  2 n  times  is 
p2(2n) .  This  probability  is  greater  than  or  equal  to  the  probability  that  a  first  equali¬ 
zation  will  occur  not  later  than  the  »-th  time  followed  by  a  second  equalization  not 
later  than  the  2»-th  time.  This  probability  is  greater  than  or  equal  to  x2.  We  have 
P2(2n)  ^  *«• 

.  Similarly,  ppn)  is  greater  than  or  equal  to  the  probability  that  a  first  equaliza¬ 
tion  will  occur  not  later  than  the  »-th  time,  followed  by  a  second  equalization  not 
later  than  the  2»-th  time,  followed  by  a  third  equalization  not  later  than  the 
3»-th  time.  This  probability  is  greater  than  or  equal  to  x®.  In  general,  we  have 


(n) 


(2) 


pI*”1  &  *£ 


Letting  n  tend  to  infinity,  we  have 

(3)  Pk  ^  7T* 

On  the  other  hand, 


p<"}  ^  x 


p(2n)  S  X2 


P*(n)  ^  X*  . 


Letting  n  tend  to  infinity,  we  have 

(4) 

From  (3)  and  (4),  it  follows  that 

(5) 

4.  Lemma.  If  the  series 


Pk  = 


Pk=  TT* 


(ml)  1 


(6) 
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diverges,  7 r  =  I.  If  the  series  (6)  has  the  sum  a,  x  =  cr/(l  +  cr)  and  is  therefore  less 
than  1. 

Proof.  First,  using  (5)  we  have 


(7) 


Y'  ( ml) ! 
2*  m\llml 

m  =  1 


=  p(^)  +  p(^)  +  .  -  -  +  p« 

=  Pl  +  P2  +  •  •  •  +  Pn  +  •  •  • 


=  7 T  +  7T2  -h  TT3  -f-  •  .  . 


Therefore, 


Second, 


7T 

1  —  7T 


a  = 


00 


2 

m  =  l 


( ml) !  <  7 r 

m\Hml  ~  1  —  7r  ’ 


>  o(«0  4-  p{Mi)  _|_ 
m\llml  pi  P2 


+  Pk 


(Ml) 


k^M  . 


Letting  M  tend  to  infinity,  we  have 


Then, 


Hence, 


a  — 


( ml) ! 
2*  m\llml 

m  =  l 


=  Pl  +  P2  +  •  •  •  +  Pfc  , 


for  any  k  . 


a  = 


2^rn\Hml=2MPk  1-7 r* 

m“l  *=1 


7T 

a  =  -j - or 

1  —  7 r 


7T 


C 

1  +  <r  ‘ 


When  the  series  (6)  diverges,  it  follows  from  (7)  that  the  series,  x  +  x2  +  7r3  + 
.  .  .  ,  must  diverge,  and  consequently  the  probability  that  an  equalization  will 
occur,  7r,  is  1.  Using  Stirling’s  formula  to  approximate  the  general  term  of  the  series 
(6),  we  have 

(ml)\~  (2t rV/Hml)-l+*e-»'  _ _ 1 _ 

m\llml  (2ir)l/Hmm+1/2)le~mllml  {2x) 


The  series  ^  m-<-l~1^2  diverges  for  /  =  2  or  /  =  3  and  converges  for  l  ^  4. 

m=  1 

Hence,  tt  =  1  for  /  =  2  or  l  =  3,  and  tt  <  1  for  /  ^  4.  Using  the  Euler-MacLaurin 
summation  formula,  we  find  that  for  l  =  4,  x  =  .231. 

6.  In  the  random  walk  representation  x  is  the  probability  of  returning  to  the 
origin.  We  shall  now  determine  the  probability  p,  of  reaching  any  given  junction 
point.  This  would  mean  the  drawing  of  ( m  +  h)  balls  of  the  first  kind,  (m  +  tf) 
balls  of  the  second  kind  and,  in  general,  ( m  +  tk)  balls  of  the  Mh  kind,  where  m  is 
an  arbitrary  nonnegative  integer.  At  least  one  of  the  fixed  nonnegative  integers, 
t\,  ti,  •  •  •  ,  th,  •  •  •  j  ti,  is  zero. 
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Let  t\  +  h  +  .  .  .  +  ti  =  T.  The  expected  number  of  times  that  the  point  de¬ 
termined  by  the  integers,  h,  h,  .  .  .  ,  ti  is  reached  in  the  first  n  times  is 

'Sp _ ( ml  +  T )  i _ 

{m  +  h)  \{m  +  h)\  ...  (m  +  ti)  !Zm*+r 

where  Ml  +  T  ^  n  <  ( M  +  1)/  +  T. 

On  the  other  hand,  it  is  also 

rin)  +  4n)  +  r<*>  +  .  .  .  + 

where  rjn)  is  the  expected  number  of  j-th  arrivals  at  the  given  point  in  the  first  n 
times.  Then  rjn)  also  represents  the  probability  that  a^-th  arrival  will  occur. 

Since  { }  is  an  increasing  sequence  bounded  by  1,  it  tends  to  a  limit.  Let 
lim  Tjn)  =  ry.  Let  r[n)  =  pn  and  lim  pn  =  p.  The  probability  of  reaching  the  given 

n—+  00  « — >co 

point  j  times  in  the  first  jn  times  is  r/,n) .  It  is  greater  than  or  equal  to  the  prob¬ 
ability  that  the  point  will  be  reached  in  the  first  n  times,  followed  by  (7  —  1)  re¬ 
turns  to  this  point  during  the  remaining  times.  Clearly,  the  probability  of  return¬ 
ing  to  this  point  (j  —  1)  times  is  not  less  than  py^fn). 

It  follows  from  this  and  (2)  that 

r(*n)  >  b  o(>'n_n)  >  b  ir1'-1  . 

1  —  •»  1  —  *n  n 


On  the  other  hand,  it  is  clear  that 

rjn)  g  p+~l . 


Passing  to  the  limit  in  both  of  these  inequalities,  we  have 

p+~l  ^  r j  ^  p+~X  . 

Therefore,  ry  =  pir]~l.  First, 

XT' _ (ml  +  T]_\ _ 

(w  +  ti) !  C  tn  -+-  h) !  •  •  -  ( tn  +  /i)  llmi+T 

=  r(Ml+T)_ (_  r(Ml+T)  r^+r) 

=  Tl  +  r2  +  *  *  •  +  rM+ 1  +  *  *  * 

=  P  +  Pn  +  P*2  +  •  •  • 


1  - 


Hence 


00 


(ml+T)\ 


m  =  0 

Second, 

— - _ *  (ml  +  T) ! 

_ _  (  'tM  -4—  f  .  \  I  (  -M 

w=0 


( m  -j-  ti) !  ( m  ^2)  1  •  •  .  ( m  -}*  t{)  \lml+  T  1  —  7 r 


V _ (  ml  +  T)  ! _ >  r)_|_  r(AfJ+T)_(_  r(Ml+  T) 

t*Am+h)\{m+h)\  .  .  .{rn+tl)\lml+T  =  1  ^  2  * 
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when  k  ^  M  +  1.  Then, 


5=2 


'0  (m  +  ti) !  (w  +  4) !  •  •  .  (m  +  4)  !/mi+r 


^  r\  +  r2  + .  .  .  +  rk 


for  any  k.  Also 


00 


Jfc=i 


Therefore 


Since 


the  series 


or 


P  = 


(1 


—  7 T)  S  = 


s 

1  +  <r 


_ (ml  +  T)\ _ (ml)  l 

(m-{-ti) !  (w  +  /2) !  •  .  .  ( m  -f-  ti)  \lml+T  m\llml  ’ 


oo 


2 

tn  =  fl 


( 


_ (ml  +  T) ! _ 

!  (m-\~h) !  .  .  ! lml+T 


diverges  for  /  =  2  or  l  =  3  and  converges  for  /  ^  4.  Consequently  for  /  ^  4, 

p  <  1. 

There  remains  the  case  for  /  =  2  or  /  —  3  in  which  the  above  series  diverges. 
We  shall  show  that  when  ir  =  1,  p  =  1  thus  taking  care  of  this  case. 

Let  max  (4)  =  t  and  4  +  4  +  •  •  .  +  U  —  T.  The  probability  of  reaching  the 
point  determined  by  the  nonnegative  integers,  (/  —  4),  {t  —  4),  ...,(/  —  4), 
on  the  (It  —  T)-th  time  is  greater  than  zero.  The  probability  of  returning  to  the 
origin  r  is  assumed  to  be  1.  Then,  the  probability  of  returning  to  the  origin  from 
the  point  determined  by  (t  —  4),  (t  —  4),  —  4)  later  than  the  (It  —  T)-th 

time  must  be  1,  for  in  this  case  there  is  no  return  to  the  origin  in  the  first  (It  —  T) 
times.  But  this  probability  is  the  same  as  the  probability  p  of  drawing  (m  +  4) 
balls  of  the  £-th  kind,  for  k  =  1,2,...,/  and  m  an  arbitrary  nonnegative  integer. 
Therefore  p  —  1. 
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